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SUMMARY 


The  Air  Force  Officer  Qualifying  Test  (AFOOT)  is  used  to  select  qualified  applicants  to 
attend  Air  Force  Officer  Training  School  (OTS)  and  the  Air  Force  Reserve  Officer  Training  Corps 
(AFROTC)  program.  The  AFOOT  is  also  used  to  select  those  qualified  for  pilot  training  or 
navigator  training. 

Four  goals  were  pursued  in  this  effort.  The  first  was  to  correlate  the  existing  subtests  and 
composites  against  performance  in  pilot  and  navigator  training  programs.  The  second  was  to 
correct  these  correlation  coefficients  for  restriction  in  range  to  estimate  the  true  relationship 
between  scores  and  training  outcomes.  The  third  goal  was  to  determine  whether  one  "aircrew" 
composite  could  be  constructed  and  used  to  select  pilots  and  navigators.  The  fourth  was  to 
construct  and  evaluate  a  variety  of  alternative  composites  which  could  be  used  for  pilot  and 
navigator  selection. 

Zero  order  correlations  were  calculated  to  validate  the  existing  AFOOT  subtests  and  composites 
against  pilot  and  navigator  training  success.  A  procedure  was  then  used  to  correct  for  restriction 
in  range  due  to  the  highly  selective  samples  used  in  the  analyses.  It  was  found  that  the  several 
subtests  and  composites  currently  being  used  in  pilot  and  navigator  selection  had  significant 
correlations  with  pilot  and  navigator  training  success,  respectively.  When  corrected  for  restriction 
in  range,  the  correlations  increased  moderately. 

Regression  models  were  used  to  investigate  the  possibility  of  constructing  a  single  aircrew 
composite  for  use  in  selection  and  classification.  Regression  analysis  revealed  that  it  is  not 
possible  to  construct  a  combined  composite  from  the  current  AFOOT  subtests  that  could  be 
used  in  selecting  both  pilots  and  navigators. 

Finally,  alternative  composites  were  developed  on  the  basis  of  their  greatest  zero  order 
correlations  with  training  pass/fail  and  their  respective  standard  error  of  estimate.  On  evaluation 
it  was  revealed  that  several  new  composites  were  more  effective  in  predicting  pilot  and  navigator 
training  success. 
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AIR  FORCE  OFFICER  QUALIFYING  TEST  (AFOOT): 
PREDICTORS  OF  UNDERGRADUATE  PILOT  TRAINING  AND 
UNDERGRADUATE  NAVIGATOR  TRAINING  SUCCESS 


I.  INTRODUCTION 

The  Air  Force  Officer  Qualifying  Test  (AFOOT)  is  a  paper-and-pencil  multiple  aptitude  test 
battery  used  to  select  individuals  for  Officer  Training  School  (OTS)  and  Air  Force  Reserve  Officer 
Training  Corps  (AFROTC).  In  general,  Individuals  wishing  to  enroll  in  the  AFROTC  program  take 
the  AFOOT  prior  to  their  freshman  year  in  college,  if  applying  for  a  4-year  scholarship,  otherwise 
prior  to  their  junior  year  in  college.  Selection  is  based  on  the  Verbal,  Quantitative,  and  Academic 
Aptitude  scores  along  with  other  criteria  (e.g.,  detachment  commander  rating;  see  Cowan,  Barrett, 
&  Wegner,  1989).  Upon  selection  into  the  program,  cadets  enroll  in  the  Professional  Officer 
Course  (POC)  beginning  in  the  junior  year.  Successful  graduates  then  enter  the  Air  Force  as 
a  second  lieutenant.  Individuals  wishing  to  enter  OTS  take  the  AFOOT  during  their  senior  year 
of  college  or  after  having  completed  the  Bachelor’s  degree.  Selection  into  OTS  is  based  on 
Academic  Aptitude  scores  and  other  criteria  (Cowan,  Barrett,  &  Wegner,  1990).  Successful 
candidates  then  complete  a  12-week  course  before  being  commissioned  as  a  second  lieutenant. 
For  both  AFROTC  and  OTS,  potential  cadets  must  have  a  minimum  percentile  score  of  15  on 
the  Verbal  composite  and  10  on  the  Quantitative  composite. 

The  AFOOT  is  also  used  to  select  AFROTC  and  OTS  candidates  for  Undergraduate  Pilot 
Training  (UPT)  and  Undergraduate  Navigator  Training  (UNT).  Air  Force  Regulation  51-4  (1986), 
provides  guidance  on  the  use  of  the  Pilot  and  Navigator-Technical  composites.  To  be  considered 
for  UPT,  applicants  must  score  at  a  minimum  of  the  25th  percentile  on  the  Pilot  composite, 
10th  percentile  on  Navigator-Technical  composite,  and  a  combination  of  50  when  Pilot  and 
Navigator-Technical  are  added  together.  UNT  applicants  must  score  at  least  at  the  25th  percentile 
on  Navigator-Technical,  10th  percentile  on  Pilot,  and  50  when  Pilot  and  Navigator-Technical  are 
added  together.  Thus,  both  composites  are  actually  used  for  selection  purposes  for  both  training 
schools. 

The  AFOOT  Form  O  is  composed  of  380  items  which  form  16  subtests  (Rogers,  Roach,  & 
Wegner,  1986;  Skinner  &  Ree,  1987).  The  subtests  are  aggregated  into  5  composites  (Table 
1).  These  are:  Pilot  (P),  Navigator-Technical  (N-T),  Academic  Aptitude  (AA),  Verbal  (V),  and 
Quantitative  (Q).  To  compute  the  composite  scores  subtest  raw  scores  are  added  together  and 
converted  to  percentile  scores  which  are  used  for  selection. 

The  purpose  of  this  research  was  fourfold.  The  first  was  to  validate  the  existing  subtests 
and  composites  for  performance  in  UPT  and  UNT.  The  approach  taken  was  to  correlate  AFOOT 
raw  scores  with  pass/fail  in  UPT  or  UNT  as  the  criterion.  The  second  goal  was  to  correct 
these  correlation  coefficients  for  restriction  in  range.  The  correction  was  necessary  because 
the  validity  coefficients  were  computed  on  highly  selected  samples.  This  underestimates  the 
true  relationship  between  the  test  scores  and  training  outcomes.  The  third  goal  was  to  determine 
whether  the  existing  Navigator-Technical  and  Pilot  composites  could  be  combined  into  a  single 
“aircrew"  composite  to  be  used  in  the  selection  of  officer  applicants  into  either  UPT  or  UNT. 
It  is  possible  that  a  single  set  of  predictors  could  be  used  in  both  sets  of  training  courses. 
The  fourth  goal  was  to  construct  and  evaluate  a  variety  of  alternative  Pilot  and  Navigator-Technical 
composites  in  the  event  that  one  “aircrew"  composite  is  not  feasible.  A  decade  ago  Hunter 
and  Thompson  (1978)  identified  the  best  set  of  subtests  for  the  Pilot  composite  while  Valentine 
(1977)  did  so  for  the  Navigator-Technical  composite.  This  research  consolidates  and  updates 
those  efforts. 
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Table  1 .  Construction  of  AFOQT  Form  0  Composites 


Subtests 

Items 

P 

N-T 

Composites 

AA 

V 

Q 

Verbal  Analogies 

25 

X 

- % - 

— 

Arithmetic  Reasoning 

25 

X 

X 

X 

Reading  Comprehension 

25 

- 

X 

X 

Data  Interpretation 

25 

X 

X 

X 

Word  Knowledge 

25 

X 

X 

Math  Knowledge 

25 

X 

X 

X 

Mechanical  Comprehension 

20 

X 

X 

• 

Electrical  Maze 

20 

X 

X 

Scale  Reading 

40 

X 

X 

Instrument  Comprehension 

20 

X 

Block  Counting 

20 

X 

X 

Table  Reading 

40 

X 

X 

Aviation  Information 

20 

X 

Rotated  Blocks 

15 

X 

General  Science 

20 

X 

Hidden  Figures 

15 

X 

II.  METHOD 


Subjects  used  in  the  analyses  were  officers  who  took  the  AFOQT  Form  O,  attended  OTS 
and  then  attended  either  UNT  (N  =  632)  or  UPT  (N  =  695).  The  subjects  ranged  in  age  from 
19  to  23  years  when  they  took  the  AFOQT  and  between  20  and  28  years  when  they  entered 
training.  The  subjects  entered  training  between  February  1982  and  April  1984  with  an  average 
delay  of  15  months  between  the  date  the  AFOQT  was  taken  and  the  date  of  entering  training. 
The  sample  consisted  of  98.9%  males  and  1.1%  females;  99%  were  white,  .5%  Black,  and  5% 
other. 

In  order  to  meet  the  four  goals  of  this  research,  several  correlational  and  regression  analyses 
were  performed.  For  the  first  two  goals  (i.e.,  validation  of  existing  subtests  and  composites 
with  UPT  and  UNT  performance)  the  predictor  variables  were  the  16  subtests  that  comprise  the 
AFOQT  along  with  the  existing  5  composites.  Raw  subtest  and  composite  scores,  expressed 
as  number  of  correct  responses,  were  used  in  the  analyses.  The  predictors  used  in  exploring 
the  possibility  of  a  single  aircrew  composite  (i.e.,  the  third  goal)  consisted  of  the  16  AFOQT 
subtest  scores  and  variables  which  represented  whether  an  individual  attended  UPT  or  UNT. 
The  predictors  used  in  evaluating  alternate  Pilot  and  Navigator-Technical  composites  (i.e.,  the 
fourth  goal)  consisted  of  the  16  subtests  in  a  variety  of  configurations.  All  analyses  which 
involved  AFOQT  used  scores  from  the  first  time  an  individual  took  the  AFOQT.  The  criterion 
for  all  of  the  analyses  described  below  was  a  dichotomous  pass/fail  variable. 

The  validities  of  existing  AFOQT  subtests  and  composites  were  estimated  through  Pearson 
product-moment  correlations  with  pass/fail  performance  In  UPT  and  UNT.  Due  to  prior  selection, 
the  variances  of  subtests  and  composites  are  curtailed  in  training  samples.  That  is,  because 
only  higher  scoring  applicants  are  selected  for  entry  to  rated  training,  the  variances  observed 
m  training  samples  for  subtests  and  composites  will  be  less  than  if  no  selection  had  occurred 
and  all  applicants  were  admitted  to  rated  training  (Thorndike,  1949).  Due  to  these  curtailed 
variances,  the  observed  validity  coefficients  will  tend  to  underestimate  the  true  validities  of 
subtest  and  composite  scores  against  UPT  and  UNT  training  outcomes. 

Subtest  validities  were  corrected  for  restriction  in  range  using  the  multivariate  procedure 
developed  by  Mifflin  and  Verna  (1977).  Data  provided  by  Skinner  and  Ree  (1987)  for  AFOQT 


applicant  scores  were  used  in  correcting  the  subtest  validities.  Corrected  composite  validities 
were  then  computed  using  the  formula  given  by  Guilford  (1950,  p.  587)  for  composite-criterion 
correlations.  The  subtest  intercorrelations  provided  by  Skinner  and  Ree  (1987)  and  the  corrected 
subtest  validities  obtained  through  the  Mifflin  and  Verna  procedure  were  used  to  obtain  corrected 
composite  validities. 

Regression  analysis  was  used  to  determine  whether  the  same  set  of  tests  could  predict 
graduation  from  both  UPT  and  UNT.  A  restricted  model  was  constructed  and  evaluated  against 
a  full  model.  The  full  model  contained  a  dichotomous  group  membership  variable  indicating 
whether  a  person  attended  UPT,  a  dichotomous  group  membership  variable  indicating  whether 
a  person  attended  UNT,  and  the  interactions  between  the  membership  variables  and  the  16 
AFOOT  subtest  scores.  Thus,  the  full  model  contained  34  predictor  variables.  The  restricted 
model  also  contained  both  dichotomous  group  membership  variables  and  the  16  AFOOT  subtest 
scores,  but  not  the  interactions  of  the  membership  variables  with  the  subtest  scores.  Thus, 
this  restricted  model  had  18  predictors.  The  restricted  model  was  compared  to  the  full  model 
and  evaluated  using  an  F-ratio. 

The  question  of  which  combination  and  weighting  of  AFOOT  subtests  would  best  predict 
successful  completion  of  UNT  and  which  subtests  would  best  predict  success  in  UPT  was 
addressed  next.  Several  alternative  composites  were  constructed  and  compared  with  the  existing 
Pilot  and  Navigator-Technical  composites.  N-Ta  and  Pa  were  designed  to  include  those  subtests 
with  the  greatest  uncorrected  zero-order  correlations.  Subtests  with  positive  regression  weights 
were  used  to  form  three  additional  alternative  composites  for  the  two  rated  composites.  N-Tb 
and  Pb  included  subtests  with  double,  unit,  and  half  weighting.  N-Tc  and  Pc  included  the  same 
subtests  as  N-Tb  and  Pb.  but  with  slightly  different  configurations  of  double,  unit,  and  half 
weighting.  N-Td  and  Pd  contained  the  same  subtests,  but  ail  had  uni:  weighting.  Subtests  in 
N-Ta  and  Pe  were  chosen  based  upon  the  error  mean  squares  computed  in  a  stepwise  regression 
analysis  using  all  16  subtests.  The  point  at  which  the  least  change  occurred  in  the  error  mean 
square  was  identified.  All  subtests  included  in  the  stepwise  regression  were  included  in  the 
proposed  composites.  Composites  N-Tf  and  Pf  were  composed  of  a  subset  of  N-T#  and  P8 
with  only  those  subtests  having  positive  regression  weights  included. 


III.  RESULTS 

The  proportion  of  officers  completing  UPT  in  this  sample  is  .79  with  a  standard  deviation 
of  .41.  The  means  and  standard  deviations  of  ihe  AFOQT  subtests  and  composites  for  the 
pilot  sample  are  presented  in  Table  2.  A  comparison  of  the  means  with  those  of  the  general 
applicant  population  (Table  A-1)  reveals  that  on  all  subtests  pilots  score  higher  than  the  general 
population.  The  difference  tends  to  be  approximately  two  to  three  raw  score  points  for  every 
20  items.  The  greatest  differences  are  found  on  the  Instrument  Comprehension  and  Aviation 
Information  subtests.  On  the  composites,  the  difference  between  the  general  applicant  population 
and  pilots  also  tends  to  be  about  two  points  for  every  20  items  with  the  exception  of  the  Pilot 
composite.  On  that  composite,  the  difference  is  approximately  three  points  for  every  20  items. 
The  standard  deviations  for  the  two  groups  are  also  not  identical.  For  each  subtest  and 
composite,  the  standard  deviation  for  the  pilot  sample- is  less  than  that  of  the  general  applicant 
population  indicating  that  restriction  in  range  had  occurred. 

The  proportion  of  officers  in  this  sample  completing  UNT  is  .86  with  a  standard  deviation 
of  .34.  Table  3  contains  the  means  and  standard  deviations  for  the  AFOQT  subtests  and 
composites  for  the  navigator  sample.  In  general,  this  sample  tends  to  score  higher  on  average 
than  the  general  applicant  population  by  one  to  three  items  for  every  20  items.  The  subtests 
with  the  greatest  differences,  Reading  Comprehension  and  Word  Knowledge,  are  both  verbal  in 
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Table  2.  Descriptive  Statistics  ot  AFOQT  Subtest 
and  Composite  Scores  for  Pilot  Sample  (N  =  695) 


Subtest 

Number 
of  items 

Mean 

SD 

Verbal  Analogies 

22 

15.14 

Arithmetic  Reasoning 

21 

13.41 

3.53 

Reading  Comprehension 

25 

19.21 

4.33 

Data  Interpretation 

23 

13.78 

3.41 

Word  Knowledge 

24 

15.83 

4.92 

Math  Knowledge 

25 

16.12 

4.97 

Mechanical  Comprehension 

19 

12.50 

3.12 

Electrical  Maze 

20 

9.34 

4.04 

Scale  Reading 

39 

24.59 

5.10 

Instrument  Comprehension 

20 

14.33 

4.20 

Block  Counting 

20 

13.03 

3.53 

Table  Reading 

40 

30.52 

5.74 

Aviation  Information 

20 

14.94 

3.86 

Rotated  Blocks 

15 

9.17 

2.79 

General  Science 

20 

10.57 

3.22 

Hidden  Figures 

15 

10.56 

2.54 

Composite 

Pilot 

200 

134.37 

17.80 

Navigator-Technical 

257 

163.57 

24.91 

Academic  Aptituoe 

140 

93.49 

17.77 

Verbal 

71 

50.18 

10.82 

Quantitative 

69 

43.31 

9.91 

Table  3.  Descriptive  Statistics  of  AFOQT  Subtest 
and  Composite  Scores  for  Navigator  Sample  (N  =  632) 


Number 


Subtest  of  items  Mean  SD 


Verbal  Analogies 

22 

15.72 

3.10 

Arithmetic  Reasoning 

21 

13.49 

3.59 

Reading  Comprehension 

25 

19.79 

4.11 

Data  Interpretation 

23 

13.48 

3.43 

Word  Knowledge 

24 

17.13 

4.85 

Math  Knowledge 

25 

16.32 

4.67 

Mechanical  Comprehension 

19 

11.80 

3.01 

Electrical  Maze 

20 

8.88 

4.04 

Scale  Reading 

39 

23.88 

5.13 

Instrument  Comprehension 

20 

11.04 

4.38 

Block  Counting 

20 

12.89 

3.70 

Table  Reading 

40 

30.00 

5.83 

Aviation  Information 

20 

10.56 

3.98 

Rotated  Blocks 

15 

8.88 

2.82 

General  Science 

20 

10.01 

3.24 

Hidden  Figures 

15 

10.48 

2.46 

Composite 

Pilot 

200 

124.79 

18.76 

Navigator-Technical 

257 

160.13 

24.52 

Academic  Aptitude 

140 

95.93 

16.75 

Verbal 

71 

52.64 

10.34 

Quantitative 

69 

43.29 

9.64 

nature.  On  the  composites,  navigators  score  about  two  raw  score  points  higher  per  20  kerns  on  four 
composites,  but  approximately  three  points  higher  per  20  items  on  the  Verba'  composite.  The  pattern  for 
the  standard  deviations  for  the  navigators  is  similar  to  that  of  the  pilots.  In  ait  cases  the  standard  deviations 
are  lower  than  those  of  the  general  applicant  population,  again  indicating  that  restriction  in  range  had 
occurred. 

The  subtest  intercorreiation  matrices  for  the  pilot  and  navigator  samples  are  presented  in 
Tables  4  and  5,  respectively.  One  salient  feature  of  these  matrices  is  that  the  correlations, 
between  subtests  for  the  two  samples  are  lower  than  the  corresponding  correlations  in  the 
general  applicant  population  (Table  A-2).  Again  the  restriction  in  scores  is  evident. 

The  composite  intercorreiation  matrices  for  the  two  samples  are  presented  in  Tables  6  and 
7,  respectively.  Caution  is  needed  when  interpreting  these  tables,  because  the  correlations  are 
spuriously  inflated  due  to  common  subtests  appearing  across  composites  (see  Table  1).  As 
with  the  subtest  intercorrelations,  composite  intercorrelations  for  the  pilots  and  navigators  are 
generally  lower  than  those  of  the  general  population  (Table  A-3). 

Table  8  presents  the  uncorrected  and  corrected  zero  order  correlations  of  the  16  AFOQT 
subtests  and  five  existing  composites  with  success  in  UNT  and  UPT.  Overall,  the  subtests  that 
are  currently  being  used  in  the  Pilot  and  Navigator-Technical  composites  had  significant  correlations 
with  success  in  UPT  and  UNT,  respectively.  One  interesting  result  of  the  correction  for  range 
restriction  procedure  is  that  an  uncorrected  correlation  that  is  negative  in  direction  may  change 
to  a  positive  corrected  correlation.  This  is  because  an  entire  system  of  variances  and  covariances 
is  used  in  correcting  feature  correlations. 

In  the  UNT  sample,  five  subtests  were  found  to  yield  corrected  correlations  with  UNT  success 
equal  to  or  greater  than  .20,  those  being  Arithmetic  Reasoning,  Math  Knowledge,  Scale  Reading, 
Block  Counting,  and  Rotated  Blocks.  All  five  subtests  are  included  in  the  current 
Navigator-Technical  composite.  However,  the  General  Science  subtast  (a  constituent  of  the 
current  Navigator-Technical  composite)  was  not  found  to  yield  a  significant  zero-order  correlation 
with  UNT  success. 

Overall,  the  subtests  in  the  Navigator-Technical  composite  with  significant  correlations  can 
be  described  as  being  visual -spatial  or  quantitative  in  nature.  For  example,  among  the  subtests 
with  the  highest  correlations  were  Scale  Reading  and  Arithmetic  Reasoning.  No  subtest  having 
a  large  verbal  component  (e.g.,  Verbal  Analogies,  Reading  Comprehension)  had  a  significant 
correlation  with  success  in  UNT. 

in  the  UNT  sample,  three  of  the  five  AFOQT  composites  had  significant  uncorrected  validities 
with  UNT  outcome  (Pilot,  Navigator-Technical,  and  Quantitative).  When  corrected  for  restriction 
in  range,  three  composites  had  correlations  with  UNT  performance  that  were  greater  than  .20 
(Pilot,  Navigator-Technical,  and  Quantitative). 

In  the  UPT  sample,  four  of  the  eight  subtests  in  the  existing  Pilot  composite  had  significant 
uncorrected  correlations  with  success  in  UPT.  These  were  Mechanical  Comprehension,  Scale 
Reading,  Instrument  Comprehension,  and  Aviation  Information.  Four  subtests  comprising  the 
Pilot  composite  failed  to  reach  significance  (Verbal  Analogies,  Electrical  Maze,  Block  Counting, 
and  Table  Reading).  In  addition,  three  subtests  that  are  not  in  the  current  Pilot  composite  were 
significantly  related  to  the  criterion.  They  were  Data  Interpretation,  Word  Knowledge,  and  Rotated 
Blocks.  The  Word  Knowledge  subtest  correlation  was  in  a  negative  direction,  but  this  is  most 
likely  due  to  range  restriction. 
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Table  4.  Intercorrelation  Matrix  of  AFOOT  Subteats  for  Pilot  Sample  (N  =  695) 


Table  6.  Correlation  Matrix  of  AFOQT  Composites 
for  Pilot  Sample  (N  =  695) 


Composite 

Pilot 

Navigator- 

Technical 

Academic 

Aptitude 

Verbal 

Quantitative 

Pilot 

1.00 

Navigator-Technical 

.86 

1.00 

Academic  Aptitude 

.53 

.73 

1.00 

Verbal 

.34 

.43 

.87 

1.00 

Quantitative 

.57 

.83 

.84 

.47 

1.00 

Not*.  Th*  correlations 

are  inflated, 

since  the  composites  hav*  several  subtests 

in  common. 

Table  7.  Correlation  Matrix  of  AFOQT  Composites 

for  Navigator  Sample  (N  =  632) 

Navigator- 

Academic 

Composite 

Pilot 

Technical 

Aptitude 

Verbal 

Quantitative 

Pilot 

1.00 

Navigator-Technical 

.87 

1.00 

Academic  Aptitude 

.50 

.69 

1.00 

Verbal 

.35 

.38 

.85 

1.00 

Quantitative 

.50 

.79 

.83 

.41 

1.00 

Not*.  The  correlations  are  inflated,  since  the  composites  have  several  subtests  in  common. 


The  subtests  that  yielded  the  highest  corrected  validities  with  success  in  UPT  tended  to  be 
visual-spatial  or  highly  related  to  specific  flying  information.  The  two  subtests  with  the  highest 
correlations  are  Instrument  Comprehension  and  Aviation  Information.  Others  that  had  large 
correlations  included  Rotated  Blocks.  Scale  Reading,  and  Block  Counting,  all  visual-spatial  type 
tasks.  Verbal  subtests  were  found  to  have  low  validities.  This  may  be  due  to  requiring  OTS 
applicants  to  have  a  college  degree  which  curtails  the  variance  in  tests  in  the  AFOQT. 

Of  the  uncorrected  composite  validities  in  the  UPT  sample,  only  the  Pilot  and  the 
Navigator-Technical  composites  were  positively  and  significantly  related  to  UPT  outcome.  However, 
when  the  attenuation  correction  procedures  were  applied  all  five  AFOQT  composites  were 
positively  related  to  UPT  outcome,  although  the  Verbal  composite  showed  a  low  corrected 
validity  with  UPT  success. 

In  examining  the  question  of  whether  a  common  aircrew  composite  could  be  used  in  place 
of  separate  Pilot  and  Navigator-Technical  composites  F-tests  were  used  to  compare  a  full 
regression  model  with  a  restricted  model.  This  test  revealed  a  significant  difference  between 
the  restricted  (R  =  .31)  and  full  (R  =  .37)  model  indicating  that  there  was  a  significant  loss 
in  the  ability  to  predict  success  in  UPT  and  UNT  when  a  common  regression  equation  is  used, 
F  (16,  1293)  =  3.65,  £  <  .001.  This  means  that  it  is  better  to  have  separate  composites  for 
selection  into  UNT  and  UPT. 

The  question  of  which  combination  and  weighting  of  AFOQT  subtests  would  best  predict 
successful  completion  of  UNT  and  UPT  was  addressed  next.  Table  9  shows  the  alternative 
composites  with  their  resulting  uncorrected  correlations  and  standard  errors  of  estimate  (SEE). 
For  the  Navigator-Technical  composite,  zero-order  correlations  ranged  from  .15  to  .23.  The 
highest  correlations  and  lowest  SEEs  were  found  in  N-Tb,  c,  d,  and  f.  Based  on  a  principle  of 
parsimony,  N-Tf  is  the  most  desirable,  because  it  has  the  fewest  number  of  subtests  forming 
the  composite.  Nonetheless,  the  most  improved  Navigator-Technical  composite  would  account 
for  only  a  small  increase  in  predictive  accuracy  over  the  existing  Navigator-Technical  composite. 


7 


Table  8.  Correlations  of  AFOQT  Subtests  and  Composites 
with  UkT  (N  =  632)  and  UPT  (N  =  695)  Pass/Fail  Criteria* 


OUT 

UPT 

Uncorrected  Corrected 

Uncorrected 

Corrected 

Subtest 

Verbal  Analogies 

-.06 

.04 

-.05 

.09 

Arithmetic  Reasoning 

.18**** 

.23 

.04 

.16 

Reading  Comprehension 

-.04 

.05 

-.04 

.12 

Data  Interpretation 

.09* 

.17 

.09* 

.19 

Word  Knowledge 

-.06 

.01 

-.11*** 

.04 

Math  Knowledge 

■)  4**-** 

.21 

-.01 

.15 

Mechanical  Comprehension 

.07 

.17 

.11*** 

.21 

Electrical  Maze 

.09* 

.16 

.05 

.15 

Scale  Reading 

•j  g**** 

.25 

.09* 

.21 

Instrument  Comprehension 

.06 

.16 

.34**** 

.38 

Block  Counting 

.15**** 

.24 

.04 

.19 

Table  Reading 

.13**** 

.19 

.06 

.16 

Aviation  Information 

.06 

.13 

.27**** 

.30 

Rotated  Blocks 

.20 

.11*** 

.23 

General  Science 

-.01 

.07 

.02 

.13 

Hidden  Figures 

.11** 

.17 

.05 

.16 

Multiple  R 

.255 

.395 

Composites 

Pilot 

1 y**** 

.25 

.21**** 

.30 

Navigator-Technical 

2i *★** 

.27 

.10** 

.24 

Academic  Aptitude 

.06 

.14 

-.03 

.15 

Verbal 

-.06 

.04 

-.08* 

.09 

Quantitative 

1 y **★* 

.23 

.04 

.19 

*p  <  .05. 

*»p  <  .01. 

***p  <  .005. 

•***p  <  .001. 

aTo  data,  there  is  no  wail  accepted  significant  test  for  correlations  corrected  for  attenuation. 

Greater  increases  in  observed  validities  were  noted  In  the  alternative  Pilot  composites.  While 
the  existing  Pilot  composite's  correlation  with  the  UPT  criterion  was  .21 ,  the  P,  and  Pb  composites’ 
correlations  were  .30.  Pa  and  Pb  composites  also  had  lower  SEEs  than  the  existing  Pilot 
composite.  Thus,  the  existing  Pilot  composite  has  slightly  less  predictive  accuracy  than  the 
alternative  composites  Pa  and  Pb.  Nonetheless,  the  increases  in  the  ability  to  predict  success 
in  UPT  and  UNT  found  here  are  not  sufficient  to  warrant  recommended  changes  in  the  composites 
at  this  time. 
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Table  9.  Uncorrected  Correlations  Between  AFOQT  Predictors  and  Pass/Fail 
for  Existing  and  Alternative  Navigator-Technical  (N-T)  and  Pilot  (P)  Composites 


Composite 

Subtest  content 

R 

SEE 

Existing  N-T 

=  AR  +  DI  +  MK  +  MC  +  EM  +  SR  +  BC+TR  +  RB  +  GS  +  HF 

.21 

.336 

N-Ta 

=  AR  +  DI  +  MK  +  SR  +  BC+TR  +  RB  +  HF 

.22 

.334 

N-Tb 

=  2(AR  +  BC)  +  MK  +  MC  +  SR  +  Al  +  RB  +  HF  +  .5(TR) 

.23 

.334 

N-Tcb 

=  2(AR)  +  MK  +  BC  +  Al  +  RB  +  HF  +  .5(MC  +  SR  +  TR) 

.23 

.334 

N-Td 

=  AR  +  MK  +  MC  +  SR  +  BC  +  TR  +  Al  +  RB  +  HF 

.23 

.334 

n-tJ 

=  VA  +  AR  +  WK  +  MK  +  SR  +  BC  +  AI  +  RB  +  GS  +  HF 

.15 

.339 

N'T, 

=  AR  +  MK  +  SR  +  BC  +  AI  +  RB  +  HF 

.23 

.334 

Existing  P 

=  VA  +  MC  +  EM  +  SR  +  IC  +  BC  +  TR  +  AI 

.21 

.398 

Pa 

=  MC  +  SR  +  IC  +  AI  +  RB 

.30 

.387 

Pb 

=  2(IC  +  Al  +  RB)  +  RC  +  .5(AR  +  Dl  +  MC  +  SR  +TR  +  HF) 

.30 

.387 

Pc 

=  2(IC)  +  RC  +  MC  +  AI  +  RB  +  .5(AR  +  DI  +  SR  +  TR  +  HF) 

.28 

.391 

pd 

=  AR  +  RC  +  Dl  +  MC  +  SR  +  1C  +  TR  +  Al  +  RB  +  HF 

.21 

.398 

P, 

=  RC  +  WK  +  EM  +  IC  +  AI  +  RB  +  GS 

.15 

.402 

pt 

=  RC  +  IC  +  AI +  RB 

.28 

.390 

Note.  N-Ta_f  »  Navigator-Technical  Alternative  Composites,  Pa  f  »  Pilot  Alternative  Composites,  VA  =  Verbal 
Analogies,  AR  -  Arithmetic  Reasoning,  RC  *  Reading  Comprehension,  Dl  -  Data  interpretation,  WK  »  Word  Knowledge, 
MK  «  Math  Knowledge,  MC  »  Mechanical  Comprehension,  EM  »  Electrical  Maze,  SR  »  Scale  Reading,  1C  «*  Instrument 
Comprehension,  BC  -  Block  Counting,  TR  -  Table  Reading,  Al  »  Aviation  Information,  RB  »  Rotated  Blocks,  GS  » 
General  Science,  and  HF  »  Hidden  Figures. 


IV.  SUMMARY 

The  findings  in  this  study  support  the  use  of  specialized  aircrew  composites  to  select  pilots 
and  navigators  as  is  current  practice.  A  single  equation  that  predicted  success  in  both  UPT 
and  UNT  was  found  to  be  significantly  different  than  an  equation  which  predicted  success  in 
UPT  and  UNT  separately.  This  means  that  predicting  success  In  UPT  and  UNT  is  best  handled 
by  two  distinct  composites.  In  exploring  the  validities  of  subtests  and  composites,  several 
subtests  proved  to  be  more  effective  than  others  in  predicting  success  in  UNT  and  UPT.  Some 
of  the  subtests  in  the  existing  composites  were  not  useful  in  predicting  pass/fail  in  UNT  or  UPT. 
Conversely,  some  subtests  not  included  in  the  existing  composites  were  found  to  have  some 
predictive  validity  for  navigator  and  pilot  training.  Furthermore,  from  the  preliminary  construction 
of  alternative  composites,  it  appears  that  while  new  configurations  of  subtests  might  result  in 
composites  which  have  equivalent  predictive  validity  using  fewer  subtests,  none  of  the  alternatives 
provided  a  practical  increase  in  validity. 


It  is  interesting  to  note  however  that  an  optimal  equation  (using  both  positive  and  negative 
weights)  had  an  uncorrected  validity  of  .395  in  predicting  UPT  success  as  compared  to  a 
corrected  validity  of  .30  for  the  current  pilot  composite.  An  uncorrected  validity  of  .40  probably 
represents  an  “upper  bound"  estimate  of  how  much  improvement  potential  exists  in  this  area. 
Future  efforts  will  need  to  explore  more  creative  strategies  for  composite  construction  if  this 
potential  is  to  be  realized. 
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APPENDIX  A:  DESCRIPTION  OF  SAMPLE  USED  IN 
RERSe  RESTRICTION  CORRECTION 


Table  A-i.  Descriptive  Statistics  of  AFOQT  and  Composite 
Subtest  Scores  (N  =  3000) 


Number 
of  items 

Mean 

SD 

Skew 

Kurtosis 

Reliability 

subtest 

Verbal  Analogies 

22 

13.36 

4.23 

-.39 

-.40 

.80 

Arithmetic  Reasoning 

21 

11.00 

4.40 

.07 

-.66 

.81 

Reading  Comprehension 

25 

15.83 

5.93 

-.30 

-.93 

.88 

Data  Interpretation 

23 

11.15 

3.93 

.18 

-.36 

.71 

Word  Knowledge 

24 

13.28 

5.83 

.08 

-.99 

.88 

Math  Knowledge 

25 

14.48 

6.04 

-.04 

-1.07 

.88 

Mechanical  Comprehension 

19 

9.78 

3.65 

.01 

-.58 

.71 

Electrical  Maze 

20 

7.68 

4.22 

.75 

.24 

.81 

Scale  Reading 

39 

20.07 

6.73 

-.03 

-.37 

.84 

Instrument  Comprehension 

20 

8.82 

4.76 

.36 

-.69 

.84 

Block  Counting 

20 

10.62 

4.39 

i 

b 

00 

-.58 

.83 

Table  Reading 

40 

26.46 

7.35 

-.50 

.50 

.92 

Aviation  Information 

20 

8.65 

4.08 

.56 

-.16 

.77 

Rotated  Blocks 

15 

7.59 

3.36 

CD 

O 

i 

O) 

.77 

General  Science 

20 

8.54 

3.66 

.42 

-.29 

.70 

Hidden  Figures 

15 

9.60 

2.76 

-.32 

.03 

.69 

Composite 

Pilot 

200 

105.44 

27.84 

-.17 

-.21 

Navigator-Technical 

257 

136.96 

36.58 

-.12 

-.36 

Academic  Aptitude 

140 

79.10 

24.56 

-.12 

-.71 

Verbal 

71 

42.47 

14.51 

-.19 

-.84 

Quantitative 

69 

36.63 

12.66 

.07 

-.79 

Estimated  by  coefficient  alpha. 
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Table  A-3.  Intercorrelations  Among  Composites  (N  =  3000) 


Pilot 

Navigator- 

Technical 

Academic 

Aptitude 

Verbal 

Quantitative 

pm  - 

1.00 

Navigator-Technical 

.95 

1.00 

Academic  Aptitude 

.75 

.83 

1.00 

Verbal 

.62 

.63 

.92 

1.00 

Quantitative 

.76 

.89 

.89 

.63 

1.00 

Not*.  The  correlations  are  inflated,  since  the  composites  have  several  subtests  in  common. 
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